Fast learning with incremental RBF
نویسنده
چکیده
We present a new algorithm for the construction of radial basis function (RBF) networks. The method uses accumulated error information to determine where to insert new units. The diameter of the localized units is chosen based on the mutual distances of the units. To have the distance information always available, it is held up-to-date by a Hebbian learning rule adapted from the "Neural Gas" algorithm. The new method has several advantages over existing methods and is able to generate small, well-generalizing networks with comparably few sweeps through the training data.
منابع مشابه
A Fast Incremental Learning Algorithm of RBF Networks with Long-Term Memory
To avoid the catastrophic interference in incremental learning, we have proposed Resource Allocating Network with Long Term Memory (RAN-LTM). In RAN-LTM, not only a new training sample but also some memory items stored in Long-Term Memory are trained based on a gradient descent algorithm. In general, the gradient descent algorithm is usually slow and can be easily fallen into local minima. To s...
متن کاملA fast online learning algorithm of radial basis function network with locality sensitive hashing
In this paper, we propose a new incremental learning algorithm of Radial Basis Function (RBF) Network to accelerate the learning for largescale data sequence. Along with the development of the internet and sensor technologies, a time series of large data chunk are continuously generated in our daily life. Thus it is usually difficult to learn all the data within a short period. A remedy for thi...
متن کاملConstructive Methods for a New Classifier Based on a Radial-Basis-Function Neural Network Accelerated by a Tree
We present a new constructive algorithm for building Radial-Basis-Function (RBF) network classiiers and a tree based associated algorithm for fast processing of the network. This method, named Constructive Tree Radial-Basis-Function (CTRBF), allows to build and train a RBF network in one pass over the training data set. The training can be in supervised or unsupervised mode. Furthermore, the al...
متن کاملStatistical Control of RBF - like Networks forClassi
Incremental Net Pro (IncNet Pro) with local learning feature and statistically controlled growing and pruning of the network is introduced. The architecture of the net is based on RBF networks. Extended Kalman Filter algorithm and its new fast version is proposed and used as learning algorithm. IncNet Pro is similar to the Resource Allocation Network described by Platt in the main idea of the e...
متن کاملStatistical Control of Growing and Pruning in Rbf-like Neural Networks
Abstract: Incremental Net Pro (IncNet Pro) with local learning feature and statistically controlled growing and pruning of the network is introduced. The architecture of the net is based on RBF networks. Extended Kalman Filter algorithm and its new fast version is proposed and used as learning algorithm. IncNet Pro is similar to the Resource Allocation Network described by Platt in the main ide...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1994